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FIELD 

The present invention relates to front side bus interrupt delivery and 
redirection, more particularly, conversion of interrupts and hardware signals into 
front side bus interrupt transactions, redirection of interrupts, support and 
preferred ordering of XTPR update transactions and interrupts marked re- 
directable. 

BACKGROUND 

An input/output (I/O) device within a computer system periodically 
requests service from a processor. The I/O device generates a signal known as an 
interrupt request (IRQ) to obtain the processor's service. The type of service 
required by the I/O device depends on the type of device and its current 
condition. For example, a keyboard interface circuit generates an interrupt 
request to inform a processor that a key has been pressed on a computer 
keyboard. The processor then responds by performing an I/O read bus cycle to 
get the corresponding keyboard character. Advanced programmable interrupt 
controllers (APICs) are sometimes used to control the interrupt process. For 
some time, APICs have been coupled together by way of an APIC bus upon 
which inter-processor interrupts (IPIs) are generated. The three wire APIC bus 
has also been used to send interrupts from the APICs to the central processing 
unit (CPU). 

Presently, processors do not support APIC interrupt delivery via a three 
wire APIC sideband bus. For example, the Willamette and Foster central 
processing imit (CPU) supports front side bus (FSB) interrupt delivery and not 
the APIC serial bus interrupt delivery of prior art systems, 

BRIEF DESCRIPTION OF THE DRAWINGS 



Additional advantages of the invention will become apparent upon 
reading the following detailed description and upon reference to the drawings, in 
which: 
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Fig. 1 depicts a hardware IRQ lOxAPIC interrupt flow diagram, in an 
embodiment of the invention; 

Fig. 2 depicts a MSI to FSB flow diagram, in an embodiment of the 
invention; 

Fig. 3 depicts a MSI to Upstream lOxAPIC flow diagram, in an 
embodiment of the invention; 

Fig. 4 depicts a MSI to peer lOxAPIC flow diagram, in an embodiment of 
the invention; 

Fig. 5 depicts a flow diagram of IPI without redirection, in an embodiment 
of the invention; and 

Fig. 6 depicts a flow diagram of IPI with redirection, in an embodiment of 
the invention. 



modifications can be made while remaining within the scope of the claims. 

A need exists to support APIC interrupt delivery. The present invention 
provides a method and apparatus for delivering APIC interrupts to a processor, 
or between processors, as FSB transactions. 

The invention provides many advantages over known interrupt delivery 
techniques. One advantage includes ensuring simplified producer and consumer 
data transfer coherency between interfaces. For example, in the case in which a 
bus mastering hard disk controller resides on a peripheral component 
interconnect (PCI) bus and transfers a block of data to a system memory, the hard 
disk controller writes the last portion of the data block into memory, generates an 
interrupt via the interrupt controller to the CPU and instructs the CPU that the 
data in memory is updated and useable. However, there are many layers of 
temporary storage buffers in the path between the hard disk controller and 
memory to act as an elastic buffer, absorb the data and write it to memory in the 
event that the memory is busy. Temporary buffers reside in the I/O controller 
Hub (ICH) and the Memory Controller Hub (MCH). The indication that data is 
ready is communicated from the interrupt controller to the CPU on a set of 



DETAILED DESCRIPTION 



Exemplary embodiments are described with reference to specific 
configurations. Those skilled in the art will appreciate that various changes and 
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dedicated serial APIC wires. When the CPU receives the interrupt, data may still 
be in temporary storage buffers. Since the CPU receives an interrupt, it reads 
and processes old data in memory. To avoid this problem, prior art chipsets 
block the transmission of the interrupt to the CPU imtil it is known that data is 
physically in system memory. However, high bandwidth and highly concurrent 
chipsets often lead to performance degradations and system hangs due to 
deadlocks. In one embodiment, the invention overcomes this limitation by 
teaching FSB interrupt delivery. That is, the hard disk controller transfers data to 
memory using memory writes and the chipset propagates memory writes to 
system memory in the order generated. When the hard disk controller issues the 
subsequent interrupt, since the interrupt is in the form of a Memory Write, the 
"interrupt" memory write "pushes" the data memory writes ahead to system 
memory. When the CPU receives the interrupt, the data is in system memory. 
The MCH must ensure that all data pipes (isochronous, asynchronous, snooped, 
non-snooped) of a particular Hub interface are flushed upstream prior to 
propagating the interrupt upstream. Since the address field contains information 
pertaining to the interrupt instead of a real address, the MCH also must provide 
a mechanism to steer the interrupt message data to the appropriate field of the 
FSB interrupt transaction. The MCH also receives the end of interrupt (EOI) 
transaction from the microprocessor(s) and broadcasts it to all downstream Hub 
Interfaces that potentially contain lOXAPICs that may be generating level mode 
interrupts. 

A second advantage involves reduction of pin coimt. Currently the APIC 
communicates interrupts to the CPU using a dedicated set of three wires, the 
serial APIC bus. The component containing the APIC and the CPU require a set 
of these three signals. However, in accordance with the teachings of the present 
invention, using FSB interrupt delivery, interrupts are delivered over existing 
address/data paths used for other system data transactions, and three to five 
signals are saved on both the ICH and the CPU, saving cost. 

A third advantage involves a system clock. In prior art systems, the serial 
APIC bus required its own clocking signal, requiring an output from the system 
clock driver chip. In accordance with the teachings of the present invention, 
having FSB interrupt delivery, this clock is no longer needed, saving cost. 
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In an embodiment, as shown in Figure 1, APIC interrupt 26 is delivered 
to processor 2, or between processors, as FSB transaction 4. A chipset, 
comprising MCH 6 and ICH 12, provides interrupt re-direction for upstream and 
inter-processor interrupts (IPI), previously provided by a system advanced 
5 programmable interrupt controller (APIC). The invention provides a method 

and apparatus for interrupt re-direction, including support for the task priority 
register (XTPR) transactions to update XTPR registers in the chipset, and a 
mechanism to provide preferred (or correct) ordering of XTPR Trarisaction and 
interrupts that are to be redirected. 

10 In an embodiment, interrupts marked lowest priority re-directable need to 

be re-directed to the lowest priority processor. Upstream interrupts and IPIs 
may both be marked as lowest priority re-directable. MCH 6 redirects these 
interrupts based on the most current task priority information. Task priority 
information is periodically downloaded by processors 2 into a task priority 
=!15 registers in MCH 6 using FSB xTPR update transactions. MCH 6 takes 

B precautions ensure a re-directable interrupt occuring about the same time as a 

^ XTPR update transaction uses valid information for the re-direction process. For 

re-directable upstream interrupts occurring simultaneously with an XTPR 

i 

p Update Transaction, MCH 6 ensures that valid task priority information is 

i;20 provided from the TPR registers. For re-directable EPIs, MCH 6 ensures that an 

3 interrupt is re-directed using the correct TPR register contents in the event that 

an IPI is immediately preceded by, or immediately followed by an XTPR update. 

In an embodiment, PCI device 24 asserts an interrupt signal to ICH 12 or 
P64H 14. P64H is an expansion bridge chip that creates multiple PCI bus 
25 segments. lOXAPIC 16 in ICH 12 or P64H 14 converts the interrupt into an 

upstream interrupt message memory write that is sent over a Hub Interface to 
MCH 6. MCH 6 converts the Hub Interface interrupt message to a FSB Interrupt 
Transaction that is then interpreted by processor 2. 

Alternatively, in another embodiment, a PCI device may generate an 
30 interrupt as an message signaled interrupt (MSI). The MSI is in the form of an 

upstream memory write to a selected address range. The ICH forwards the MSI 
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over a Hub Interface to a MCH, The MCH converts the Hub Interface interrupt 
message to a FSB interrupt Transaction that is then interpreted by the processor. 

As an example, Willamette and Foster CPUs support FSB interrupt 
delivery and do not support the APIC serial bus interrupt delivery mechanism. 
In one embodiment, interrupt related messages are encoded on the FSB as 
"Interrupt Message Transactions". In the Colusa platform FSB interrupts may 
originate from one of the CPUs on the FSB (IPIs- inter-processor interrupts), or 
from a downstream device on HI A-E or AGP /PCI. In the later case the MCH 
drives the ''Interrupt Message Transaction" onto the FSB. 

In an embodiment, the lOxAPIC environment an interrupt is generated 
from the lOxAPIC to a CPU in the form of an upstream Memory Write. In the 
Colusa environment, ICH, P64Hs, and P64H2s contain lOxAPICs, and their 
interrupts are generated as upstream HI Memory Writes. A PCI device defines 
MSTs (Message Signaled Interrupts) that are also in the form of Memory Writes. 
A PCI device may generate an interrupt as an MSI cycle on its PCI bus instead of 
asserting a hardware signal to the lOxAPIC. The MSI may be directed to the 
lOxAPIC which in turn generates an interrupt as an upstream HI Memory Write, 
Alternatively, the MSI may be directed directly to the FSB. The target of an MSI is 
dependent on the address of the interrupt Memory Write. The Colusa MCH 
forwards inbound HI and AGP /PCI Memory Writes to the FSB as "Interrupt 
Message Transactions". 

In an embodiment, the Colusa MCH supports re-directing lowest priority 
delivery mode interrupts to the CPU that is executing the lowest priority task 
thread. The MCH re-directs interrupts based on the task priority status of each 
processor thread. The task priority of each processor thread is periodically 
downloaded to the MCH via the xTPR (Task Priority Register) Special 
Transaction. The MCH re-directs HI and PCI originated interrupts as well as IPIs. 
In an embodiment, the Colusa MCH broadcasts EOI cycles generated by a CPU 
downstream to the HI interfaces. EOIs are not forwarded to AGP/PCI. 

In an embodiment, the lOxAPIC is the lO half of the xAPIC architecture. 
The second half resides in the CPU and is referred to as the local xAPIC. The 
xAPIC is different from the prior art APIC in that interrupts are commimicated 
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from the lOxAPIC to the CPU's local xAPIC in the form of FSB Interrupt 
Messages instead of using the serial APIC bus. Interrupts are presented to the 
lOxAPIC itself in one of two ways; as IRQ hardware signals or as Memory Writes 
(MSIs) to the lOxAPIC IRQ Pin Assertion Register. For either case the IQxAPIC 
5 generates an upstream interrupt message that appears as a Memory Write to the 

MCH. Alternatively, a device may generate a MSI directly to the FSB via the 
MCH, bypassing the lOxAPIC. In this case, the MSI will be generated upstream 
as a Memory Write with the same format as an lOxAPIC upstream interrupt 
message. 

10 In an embodiment, the MCH accepts message based interrupts from 

AGP /PCI or any of its HI interfaces and forwards them to the FSB as Interrupt 
Message Transactions. The interrupt messages presented to the MCH are in the 
Q form of Memory Writes. At the HI or AGP/PCI interface the Memory Write 

ij\ interrupt message is treated like any other Memory Write; it is either posted into 

* ^15 the inboimd data buffer, or retried, if data buffer space is not immediately 

ill available. Once posted, the Memory Write from AGP/PCI or one of the HI 

J^J interfaces is decoded as a cycle that needs to be propagated by the MCH to the 

FSB as an Interrupt Message Transaction. 

E^j In alternative embodiments, upstream interrupt messages to the MCH are 

Cl20 generated in a variety of ways including hardware IRQ assertion to lOxAPIC, the 

?j lOxAPIC generates upstream interrupt messages; MSI from a PCI device directly 

to the FSB, bypassing lOxAPIC; MSI from a PCI device to upstream lOxAPIC, the 
lOxAPIC generates upstream interrupt messages; and MSI from PCI device to 
peer lOxAPIC, the lOxAPIC generates upstream interrupt messages. 
25 An embodiment of hardware IRQ lOxAPIC interrupts are shown in Figure 

1. A device asserts one of the lOxAPIC's IRQ input signals. The lOxAPIC 
generates an upstream Interrupt Memory Write to the MCH in response to the 
IRQ assertion. From the MCH's perspective the lOxAPIC's interrupt messages 
appear as incoming Memory Writes. The MCH supports inboimd interrupt 
30 Memory Writes from AGP/PCI and from any of its HI A-E interfaces. The MCH 

decodes Memory Writes as cycles that are to be routed to the FSB as Interrupt 
Message Transactions. In one embodiment, if the A3 bit of the incoming Memory 
Write is '0' the MCH forwards the Memory Write to the FSB. If A3 is '1' the MCH 



7 



042390.P9428 E^^H^ Mail No. EM560647396US 

will redirect the interrupt by substitutii\g certain bits of the address field prior to 
forwarding to the FSB. 

In an embodiment, a PCI defines Message Signaled Interrupts (MSIs). 
MSIs allow a device to request interrupt service via a standard Memory Write 
transaction instead of through a hardware signal. The Memory Write address 
determines the MSI destination and the data conveys the interrupt 
characteristics. The information sent in the address and data fields of an MSI are 
the contents of corresponding interrupt Message Address and Message Data 
Registers (respectively) in the device. These registers are configured by system 
software during initialization. 

In an embodiment, in a Colusa system, the destination of an MSI will 
either be the FSB or the Interrupt Assertion Register of one of the lOxAPICs in 
the system. In an embodiment, a PCI device may be configured to generate a 
MSI targeting the FSB. This is shown in Figure 2. 

A PCI device can be configured to generate an MSI to the FSB. To the ICH 
or P64H the incoming MSI appears as a Memory Write and will be routed based 
on standard address decoding techniques. The ICH or P64H forward the MSI 
upstream to the MCH via the HI interface, bypassing the lOxAPIC in the ICH or 
P64H. From the MCH's perspective MSIs bypassing the lOxAPIC appear as 
incoming Memory Writes. 

In an embodiment, a PCI device may be configured to generate a MSI 
targeting an upstream lOxAPIC. This is shown in Figure 3. A PCI device may be 
configured to generate a MSI targeting an upstream lOxAPIC by setting its MSI 
Message Address Register to match the address of the upstream lOxAPIC's IRQ 
Pin Assertion Register. The data field of the MSI contains the interrupt vector and 
the lOxAPIC responds by generating an upstream interrupt Memory Write just 
as if the corresponding hardware interrupt input signal on the lOxAPIC was 
asserted. 

In an embodiment, a PCI device may be configured to generate a MSI 
targeting a peer lOxAPIC. This is shown in Figure 4. FSB interrupt delivery is 
novel to the Willamette /Foster CPU. In P6 systems with serial lOAPICs, MSI is 
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directed to an lOxAPIC's IRQ Pin Assertion Register. In theory a PCI device 
capable of generating MSIs should direct their MSIs to the FSB. However to 
support MSIs in a backward compatible fashion during the transition period to 
FSB interrupt delivery, the MCH supports MSI-to-Peer lOxAPIC interrupt 
5 delivery. 

A PCI device may be configured to generate a MSI targeting a peer 
lOxAPIC by setting its MSI Message Address Register to match the address of 
the peer lOxAPIC's IRQ Pin Assertion Register. The data field of the MSI 
contains the interrupt vector and the lOxAPIC responds by generating an 
10 upstream interrupt Memory Write as if the corresponding hardware interrupt 

input signal on the lOxAPIC was asserted. 

Any CPU may generate an IPI to any other CPU on the FSB. The IPI 

Jl generated by a CPU may be directed to a particular CPU(s) or may be redirected 

W 

to the lowest priority CPU by the MCH. In an embodiment, the IPI is the direct 
^^hS type and will be accepted by the CPU(s) specified by the Destination and 

O Extended Destination fields. This is shown in Figure 5. In an embodiment, the 

IPI is the redirected type and will be accepted by the MCH. In response the MCH 
Ci will turn around and generate a direct type of FSB Interrupt Transaction based 

5 on the internal redirection logic in the MCH. This is shown in Figure 6. 

CBO The MCH generates the response phase for both the original CPU driven 

IPI transaction accepted by the MCH and the subsequent MCH driven interrupt 
transaction accepted by one of the CPUs. The MCH will drive the "No Data" 
response if the IPI can be immediately removed from the lOQ. If the MCH can 
not immediately remove the redirected IPI from the lOQ because it is processing 
25 an earlier redirected interrupt, the MCH will Retry the transaction. 

In an embodiment, the MCH redirects both upstream interrupt messages 
and IPIs. The redirection involves substituting particular bit fields with 
information that was downloaded into the MCH's xTPR registers. 

In an embodiment, the xTPR registers may be updated from a CPU. It is 
30 possible that a xTPR update may be occurring at exactly the same time that the 

xTPR register contents are being accessed for redirection purposes. The MCH 
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must internally guarantee that any redirection in progress during a xTPR register 
update is not corrupted by the update process. From a system timing standpoint, 
the system assumes that the new xTPR regiister state will be applied to any 
redirected interrupt that occurs after the response phase of the corresponding 
xTPR Special Transaction. This means that the response phase for a xTPR Special 
Transaction must be delayed until there is no redirection event occurring and 
that the new xTPR contents are valid immediately following the response phase. 

In an embodiment, one of the benefits of signaling interrupts using 
upstream Memory Writes is that any data written upstream by a device prior to 
the interrupt is pushed by the interrupt message itself. Because of this attribute, 
MSI interrupts as defined in a PCI do not require the device driver to read from 
the interrupting device prior to accessing the data block just written to memory. 
This means that the MCH must ensure data coherency for MSI interrupts. 

In an embodiment, normal upstream write ordering in the MCH will 
naturally result in prior upstream data writes through a given pipe being visible 
to the CPU before an interrupt message from the same pipe is delivered to the 
FSB. Data in all upstream sub-pipes (snooped, non-snooped, isochronous, and 
asynchronous) for a given MCH interface (HI_B, etc) must be flushed to the point 
where they are visible to the CPU prior to propagating a subsequent interrupt 
message from the same interface to the FSB. 

In an embodiment, the MCH allows peer-to-peer Memory Write traffic 
between all I/O interfaces (His and AGP /PCI). MSIs generated from one lO 
interface may be directed to an lOxAPIC on a peer lO interface, which in turn 
generates an upstream interrupt message to the FSB. For example, a PCI device 
on HI_B writes a block of data to main memory and then generates an MSI 
interrupt to an lOxAPIC on HI_C. The lOxAPIC on HI_C generates an interrupt 
message upstream targeting the FSB. The upstream interrupt message from the 
lOxAPIC on HI_C pushes writes through the upstream HI_C pipes. However a 
portion of the data block written by the PCI device on HI_B may still be in the 
HI_B inbound buffers when the interrupt from the lOxAPIC on HI_C is delivered 
to the CPU. This would result in a data coherency problem. The MCH must 
ensure that any upstream write data on a given lO interface is globally visible (to 
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lO and CPU) prior to allowing the MSI from the same interface to be sent to a 
peer lO interface. 

In an embodiment, EOI Message Transactions originate from one of the 
CPUs. The MCH claims and posts the FSB EOI Message Transaction and 
broadcasts an EOI or EOI Memory Write downstream on each of the HI A-E. For 
HI_B-E the FSB EOI is broadcast as HI EOI special cycles. For HI_A (where ICHx 
is connected) the MCH translates the FSB EOI into a HI Memory Write. This is 
done to support the ICH which does not support the HI EOI special cycle. 

The EOI is sent to all lOxAPIC in the system that support shared 
interrupts. An EOI does not need to be broadcast to the MCH's AGP/PCI 
interface. MSI interrupts are by definition non-shared edge triggered interrupts, 
and edge triggered interrupts do not require an EOI. The MCH may retry the 
FSB EOI if any one of the multiple HI paths prohibits the immediate removal of 
the EOI from the lOQ. 

Having disclosed exemplary embodiments, modifications and variations 
may be made to the disclosed embodiments while remaining within the spirit 
and scope of the invention as defined by the appended claims. 
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